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Q device ( 16) is then used to access associated information either within Lhe system ( 10) jL<;elf or on an external svsiem. Thus, in some 
^ embodiments of the present invention, any item on a given frame (36} may be liaked initially or thereattcr lo other information within 
1^ or without the particular system containing that inJormation. 
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Linking To Video Information 

Background 

This invention relates generally to linking information displayed on a video display to 
additional information. 

Hyperlinks (also called anchors or hotspots) are video display locations which a user 
5 can select lo access a document or a web site (i.e. a collection of documents). Generally, a 
given document such as a hypertext markup language (HTML) document may have a 
hyperlink programmed onto the web page by indicating a given location displayed on the web 
page. When the user operates a pointing device on the designated embedded linking area, 
additional information may be accessed. Conventionally the embedded linked area is 
10 accessed by highlighting the linked area and operating a mouse button while a cursor or 
highlighting is arranged to point to the hyperlinked site. 

The additional information may be additional video information, textual information, 
a web page or any of a variety of other information. A uniform resource locator (URL) is 
used to access the additional information. Absolute URLs locate external sites and relative 
15 URLs point to locations on the same web site or document. 

Of course, the hyperlink works because the web page is programmed to include the 
embedded pointer. Thus, the hyperlinks become part of the code which defines the web page. 
The hyperlinks can be URLs or images which have associated URLs. 

Because the hyperlinks are hard coded into the web page, once the hyperlinks are 
20 defined, it is relatively difficult to change them. Thus, if a given hyperlink points lo a given 
source such as a web page, it generally will always point to that source unless the HTML 
code is rewritten. 

In a number of circumstances, it would be desirable to enable the linking software to 
be redefined over time. Thus, at one time interval, when a user selects (or mouse clicks on) a 
25 given icon on a web page, one thing would happen and at another time a different thing 

would happen. This would allow greater flexibility and enables the web page creator to link 
to different sites at different times. For example the web page owner may sell the hx'perlinks 
to different users at different times. 

In conventional magnetic or optical media such as hard disks, magnetic tape, compact 
30 disks, digital video disks (DVD), and floppy disks, hyperlinking is generally not utilized. 
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However, it would be desirable to enable reprogrammable hyperlinks from a variety of media 
including media storing video presentations such as movies. 

Thus, there is a continuing need for better ways to link video information to other 
information in a way which may be readily reprogrammed and which is sufficiently flexible 
5 to enable additional information to be linked to information in a video presentation at various 
times. 

Summarv 

In accordance with one aspect, a method of linking information to video information 
includes linking the video information with other information based on the location of the 
10 video information on a frame and a frame identifier. The other information may be accessed 
in response to a user selection of a frame location. 

Other aspects are set forth in the accompanying detailed description and claims. 

Brief Description of the Drawings 

Fig. 1 is a front elevational view of one embodiment of the present invention; 
' 5 Fig. 2 is a schematic depiction of one implementation of the present invention; 

Fig. 3 is a schematic depiction of another embodiment of the present invention; 

Fig. 4 is a depiction of how a frame may be broken up into distinct locations with 
embedded links which may be reprogrammed in accordance with one embodiment of the 
present invention; 

20 Fig. 5 IS a flow chart showing software for implementing one embodiment of the 

.present invention in connection with a client; 

Fig. 6 is a flow chart showing software for implementing one embodiment of the 
present invention in accordance with a server; and 

Fig. 7 is a block diagram showing a client in accordance wath one embodiment of the 
25 present invention. 

Detailed Description 

A computer system 1 0 may include a processor-based unit 12 coupled to a display 14 
such as a conventional television receiver having a display screen 22. A remote control unit 
(RCU) 16 may be utilized to remotely control the unit 12 and the display 14. Thus, in 
30 accordance with one embodiment of the present invention, mouse style commands may be 
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produced by operating the directional buttons 26 to move a cursor image or highlighting on 
the display screen 22 to implement a conventional pointing function. 

The RCU 16 may be an airwave transceiver 24 which communicates with transceivers 
18 on the units 12 and 20. In this way, airwave communications may be undertaken between 
5 the components. The user can then control each component by providing input conmiands 
through the cursor controls 26, the pushbuttons 28 or the keypad 30. 

While the present invention has been illustrated in connection with a processor-based 
unit 12 which may be called a set top computer system, the present invention is applicable to 
any of a variety of processor-based systems including desktop computers, laptop computers, 
10 and processor-based appliances, as additional examples. 

The RCU 1 6 may conveniently generate and receive airwave signals such as infrared, 
radiowave or ultrasonic signals. While the present invention is illustrated in connection with 
a processor-based system 10 which uses an RCU 14 as a pointing device, the present 
invention is equally applicable to processor-based systems which are controlled using other 
1 5 pointing devices including a mouse, a roUerball, or a touchpad, as additional examples. 

In accordance with one embodiment of the present invention, the system 10 may be 
one of a plurality of similar receivers 10, shown in Fig. 2, which receive video transmissions 
(indicated by the arrow 35a) from a server 34. Each receiver 10 may communicate through a 
back charmel 35b, in accordance with one embodiment of the present invention, with the 
20 server 34. Thus, as illustrated, two-way communications may be implemented between the 
server 34 and each of the plurality of receivers 10. 

The server 34 may receive video content such as television programming from a 
content provider 32. The server 34 may also send communications to the content provider 
32. In addition, the server 34 may communicate in a two-way communication protocol with 
25 a link library 75 in accordance with one embodiment of the present invention. 

In one example of an implementation of the present invention, television 
programming may be transmitted from the server 34 to each of a plurality of receivers 10. At 
each receiver 10, a pointing device may be utilized to select a particular location in a 
particular video frame in order to access additional information. The selection may be 
30 transmitted over the back channel 35b from a receiver 1 0 to a server 34. In response, the 

server 34 may access the link library 75 to provide additional information corresponding to 
the particular location and the particular frame selected by the user of a receiver 10. That 
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information may then be transmitted, for example as indicated by the arrow 35a, from the 
server to the recewer 10. Alternatively, the additional information may be obtained from the 
content provider 32. 

A variety of transport media may be utilized to convey the additional information. 
For example, telephone, cable, satellite, and networked connections, including Internet 
connections, may be utihzed to implement the transport media. 

While the embodiment illustrated in Fig. 2 involves a video transmission system such 
as a television broadcasting system, the present invention is in no way limited to broadcast 
applications. It may likewise be applicable to any of a variety of transmissions involving 
visual information including video transmissions, movie distribution systems, or Internet web 
pages, as additional examples. 

In accordance with still another embodiment of the present invention, a medium 70 
may be provided which contains video information. The medium 70 may be, as examples, a 
floppy disk, a hard disk, a compact disk, a digital video disk, or any of a variety of optical or 
magnetic media. The medium 70 may store one or more video images which may be 
displayed on a conventional processor-based system. The processor-based system may also 
include a system memoiy. 72 which may store a variety of programs which may be executed 
on the processor-based system. 

When the user selects a given location and frame of an image currently being 
displayed on the system, the system memoiy 72 may record the selected location and its 
frame. The memory 72 may access associated information, which is stored on the medium 
70, to display additional information, in accordance with one embodiment of the present 
invention. The nature of additional infonnaiion is essentially boundless and is defined only 
as information which is linked by design to a given location in a given frame in the content 
25 originally stored on the medium 70. 

In the embodiments illustrated in Figs. 2 and 3, video data may define a video frame 
or a plurality of video frames. Each video frame may be identified (if more than one video 
frame is involved) by a frame identifier. The frame identifier identifies each frame of a 
plurality of video frames which, for example, may make up a video presentation such as a 
movie, a television program, or a web site as examples. In addition, a plurality of locations 
on a given frame may be identified relative to other frames. Thus, when the user selects a 
given location and a given frame, that location and the identified frame itself provide an 
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indication of the focus of a given user. The given location on a given frame may be linked 
through the active media (or through other media) with additional information which may be 
associated with the selected location. 

One convenient frame identifier is the time code in accordance with one of a variety 
5 of industry standards including the Society of Motion Picture and Television Engineers 

(SMPTE). Conventionally, the time codes are utilized to enable synchronization between 
audio and video tracks. The SMPTE time code synchronization system is a biphase mark 
longitudinal time code (LTC) which can be recorded onto the audio track of a video tape in 
one example. 

1 0 Another time code is the vertical interval time code (VITC). The VITC may be 

advantageous in some applications because it can be read even when the medium storing the 
video is paused. 

The SMPTE lime code is a broadcast standard time which may be recorded in the 
format HH:MM:SS;FF, where FF is a frame number between 00 and 29, HH is a two-digit 

1 5 code for hours, MM is a two-digit code for minutes and SS is a two-digit code for seconds. 
Assuming a frame rate of 30 frames per second, the SMPTE time code may identify every 
frame of a video sequence such as a movie, a television program or other video information. 

While the present invention, in one embodiment, uses a time code to identify a given 
frame, the present invention is in no way limited to the use of time codes. The time code is 

20 simply a convenient way to identify one of a plurality of frames. Any other technique may 
also be utilized to identify each of the frames including simply providing each frame with a 
sequential identifier. 

A frame 36, illustrated in Fig. 4, may be overlaid by a grid system having an X screen 
direction 40, a Y screen direction 42 and a frame identifier 38. The frame identifier provides 

25 the hours, minutes and seconds indication followed by a 00 to 29 frame number indication. 
In the embodiment illustrated in Fig. 4, the X and Y screen directions provide rectangular 
coordinates to identify a plurality of grid segments such as the segments 44 and 46. In this 
way, every image defined on the frame 36 may be identified by one or more grid coordinates 
in the X screen and Y screen directions. 

30 Thus, as illustrated in Fig. 4, a given frame 36 may have two embedded links, for 

example a link 1 and a link 2 associated with the locations 44 and 46, If these locations are 
selected by the user, they automatically link to additional information which may be stored. 
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for example, on the medium 70 in the embodiment of Fig. 3 or to the link Hbrary 75 or 
content provider 32 via the server 34 in the embodiment of Fig. 2. 

While Fig. 4 illustrates an embodiment in which a rectangular grid work is utilized to 
define locations, any of a variety of location identifying techniques may be utilized. For 
example, polar coordinates may be utilized, a patchwork of regions may be identified by 
location numbers, and any of a variety of other indication identifying techniques may be used 
as well. As another example, one or more display pixels may be associated as a link to 
additional information. 

The user may select a location 44 or 46 using a conventional pointing device such as 
the RCU 1 6. When a particular item on the display has a cursor image associated with it, in 
one embodiment of the present invention, and a mouse button is operated (such as the button 
associated with the controls 26), that particular location is selected, hi response to the 
selection of a particular location, additional information may be identified. That is, given the 
particular location in a particular frame, the processor-based system may search for 
1 5 information linked to that particular location in that particular frame. 

Thus, in one embodiment of the present invention, the content provider may know- 
that a given location in a given frame is a particular product. When the user selects that 
location, the user may be provided with additional information, such as video information, 
about the particular product. 

Because of the location system described herein, the linked information maybe added 
or changed at any time. For example, as users continue to select a given location on a given 
fi-ame, the content provider or other entity may choose to provide additional information in 
response to repeated requests. 

Similarly, the information which is provided may be changed at any time. Because 
the linJced information is not hard coded into the media, the information may be changed in 
response to the desire to update information, to change sponsorships, or to improve the 
quality of the information, as examples. 

Thus, by providing a system of location identifiers, the need for hard coding of 
hyperlinks may be avoided. This allows a dynamic system in which the linked information 
may be varied over time to meet changing needs. In addition, it enables essentially every 
item in a given video display to be selectively linked to additional information. Moreover. 
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there is no need to adjust the prograniining of a particular page such as Internet web page, but 
instead, the desired item can be identified by location. 

In the embodiment indicated in Fig. 2, the user selected locations together with the 
frame identifier may be transmitted back to the serv^er 34 over the back channel 35b to the 
5 server. The server 34 may then be responsible for obtaining the linked information for 

example from the link library 75 or the content provider 32. In this case, the receiver goes 
outside its own system to obtain the additional information through the link. 

In contrast, in the embodiment illustrated in Fig. 3, the linked information may be 
contained elsewhere on the same media 70 that originally stored the video data. In this case, 
10 the additional information may be found entirely within a single processor-based system. 

The software 48, resident on the receiver 10, may begin by receiving the video data as 
indicated in block 50 as shown in Fig. 5. The link may be established between that data and 
the time code system that is utilized by the panicular receiver For example, if the user uses 
the SMPTE time code system to identify selected locations on selected frames, synchronism 
15 of that system is established (block 52). 

Next the system awaits a user selection as indicated in diamond 54. The user 
selection may correspond to the use of a pointing device, such as the RCU 16, to select a 
particular location on a particular frame. Once the user makes the selection, the location 
identifiers are stored as indicated in block 56. The location identifiers may identify a 
20 particular location in the frame as well as a particular frame. One such identifier is the 
SMPTE time code. 

In some receivers 1 0, a recording system may be provided wherein data is 
continuously stored onto a magnetic or optical storage media such as a hard disk drive. 
When the user wishes to access additional information for viewing, the ongoing video stream 
25 may be stored. In systems which use a recording media of the type described, this may be 

accomplished by pausing the active display, continuing to record tlie received video, such as 
a television program, in the background, while displaying additional information selected for 
access by the user through the linking system described above. 

Thus, in these systems, sometimes called broadcast pause and resume systems, with 
30 this type of recording media, the pause function may be automatically activated in response 
to a user selection of a given location on a panicular frame. The pause remains in effect until 
such time as the user has finished viewing the additional information and indicates a desire to 
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retum to the ongoing video program. Thus, if the pause is active, as determined in diamond 
58, the pause may be automatically instituted for the duration of the excursion into the 
additional information as indicated in block 60. 

Thereafter, the location identifiers are transmitted through a source of video 
information associated with the link (block 62). Thus, in the embodiment shown in Fig. 2, 
the location identifiers may be sent outside of the processor-based system 10. In contrast, in 
the system shown in Fig. 3, the information may be accessed internally of the processor- 
based system. 

The location identifier for the content may be accessed such as a URL or other 
identifier as indicated in block 64. When the user selects the content as indicated in diamond 
66, content may be automatically displayed as indicated in block 68. Again, when the user 
indicates an intent to resume the original video material returning ft-om the linked 
mfoi-mation, in systems which use a on-going recording of a received video stream, the 
system may automatically transition back to display the recorded media (block 70). The 
1 5 system may accelerate through the replay of the recorded media to attempt to return to real 
time display of the just received video information, as indicated in block 70. 

Turning next to Fig. 6, software 74 which may be resident on the server 34, may 
begin by transmitting video data to one or more receivers as indicated in block 76. 
Synchronization is established with the receivers as indicated in block 78. When a request 
20 for a location identifier is received, as indicated in diamond 80, the requested links may 

automatically be located as indicated in block 82. Thus, in the embodiment illustrated in Fig. 
4, the coordinates of the particular selected location and its fi-ame may be compared to a 
database containing links for a variety of locations on a variety of fi-ames. When a link is 
accessed, it can be returned to the receiver. The return link may be a URL or other script that 
25 directs the receiver to the source of the information, or the information itself may be provided 
directly from the server to the receiver as indicated in block 84. 

In one embodiment of the invention, the user may cause indicia, such as highlighting, 
to appear at those locations that are linked to other information. This feature may be 
activated, for example, during a software set-up sequence. 
■^^ Fmally, referring to Fig. 7, the receiver 1 0 may include a processor 1 50 coupled to an 

accelerated graphics port chipset 152 (see the Accelerated Graphics Port Interface 
Specification. Revision 1.0, dated July 31, 1996 available fi-om Intel Corporation, Santa 
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Clara, California). The chipset 1 52 may be coupled to system memory 1 58 and an AGP port 
154. The port 154 communicates with a graphics accelerator 156 and a television receiver 14 
in one embodiment of the present invention. 

A bus 160, coupled to the chipset 152, also couples a TV tuner/capture card 162 
5 coupled to an appropriate antenna or other transport medium access port 164. A bus 160 also 
couples a bridge or interface 166 which may communicate with a hard disk drive 168. The 
software 48 described previously may be stored on the hard disk drive 1 68. In a broadcast 
pause and resume system the hard disk drive 168 may be buffered so that it may essentially 
simultaneously record and playback information in an interleaved or multiplexed series of 
10 store and playback sequences. 

A second bus 1 70 may be coupled between the bridge 1 66 and a serial inpuL^output 
device (SIO) 172 and a basic input/output system (BIOS) 1 74. The SIO I 72 may 
communicate with an infrared transceiver 18 which is part of the processor-based unit 12. 
The transceiver 18 communicates with a transceiver 24 on the RCU 16. The RCU 16 also 
15 includes a controller 150a coupled to a memory 158a and the keypad elements 26, 28 and 30. 

While the present invention has been described with respect to a limited number of 
embodiments, those skilled in the art will appreciate numerous modifications and variations 
therefrom. It is intended that the appended claims cover all such modifications and variations 
as fall within the true spirit and scope of this present invention. 
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What is claimed is: 


1 1 . A method of linking information to video information comprising: 

2 linking video information with other information based on the location of th.- 

3 video information on a frame and a frame identifier; and 

4 accessing said other information in response to a user selection of a frame 

5 location. 


2. The method of claim 1 including defining a display grid system and specifyi,,:. 
at least one location in said grid system using coordinates. 


1 3. The method of claim 2 including developing a frame identifier using a time 

2 code. 


1 4. The method of claim ] including linking to other information without 

encoding a hyperlink into the video information. 


1 5. The method of claim 1 including linking to other information on the same 

medium that stores said video information. 


1 6. The method of claim 1 including linking video information on one proccs.sor 

2 based system to other information on a separate processor-based system. 

1 7. The method of claim I wherein accessing said other information includes 

2 using a pointing device to select a location on a frame. 

1 8. The method of claim 1 ftirther including receiving a video stream, and pausnu 

2 said video stream when accessing said other information. 


9. The method of claim 8 including automatically resuming the playback ol saul 
video stream when the other information is no longer being accessed. 
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1 10. An article storing instructions that cause a processor-based system to: 

2 link video with other information based on the location of the video 

3 information on a frame and a frame identifier; and 

4 access said other information in response to user selection of a frame location. 

1 11. The article of claim 10 further storing instructions that cause a processor- 

2 based system to define a grid system on each frame and specify at least one location in said 

3 frame using a coordinate system. 

1 12. The article of claim 1 1 further storing instructions that cause a processor- 

2 based system to develop a frame identifier using a time code. 

1 13. The article of claim 1 0 fiirther storing instructions that cause a processor- 

2 based system to link to other information without an encoded hyperlink in the video 

3 information. 

1 14. The article of claim 1 0 further storing instructions that cause a processor- 

2 based system to link to other information on the same medium that stores said video 

3 infonriation. 

1 1 5. The article of claim 1 0 further storing instructions that cause a processor- 

2 based system to link video information on one processor-based system to other information 

3 on a separate processor-based system. 

1 1 6. The article of claim 1 0 further storing instructions that cause a processor- 

2 based system to receive a video stream, and pause the playback of the video stream when 

3 accessing the other information. 

1 1 7. The article of claim 16 further storing instructions that cause a processor- 

2 based system to resume the playback of said video stream when the other information is no 

3 longer being accessed. 


11 
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1 18. A processor-based system comprising: 

2 a processor; and 

3 a storage coupled to said processor, storing software to liak to additional 

4 information based on the user's selection of a frame and frame location. 

1 19, The system of claim 1 8 includmg a pointing device to enable the user to select 

2 a frame and frame location. 

1 20. The system of claim 18 wherein said storage stores a coordinate system for 

2 identifying locations on a frame. 
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